i 

DbCtfMEKT RESUME 



EG 244 433 EC 162 452 



. Author . thurlow, Martha b.? And Others 

TITLE Referral Research: An Integrative Sammary of 

Findings. 

fNStltUtiOH Minnesota Univ., Minneapolis. Inst, for Research on 

Learning Disabili ties . 

SPONS AGENey Special Education Programs (SD/OSERS), Washington, 

pe. . 

REPORT NO IRtD-RR-141 
PUB DATE Sep 83 

eONTRAGT 3O0-80-0S22 
ROTE S3p, 

PUB TYPE 'hformation Analyses (070) 



EDRS PRICE. ro"01/PC03 Plus Postage^ 

DESCRIPTORS ^Decision Hakihgj Eleinehtary Secondary Education; 



*Interventibn^ _*Learning Disabilities; *Refeirral; 
Research Methodology ;_Special Education ; * Student 
Evaluation; ^Student Placement 

• x^. 

ABSTRACT _ ^^^^ ' 

Six years of research on issul^0 in assessment snd 
identjif ication of learning disabilit>ies are summarized. The focus of 
tha summary is on referral processes* The fi^stch 
ma jor findings on questions of how m^ 

'*5tudent character i St ICS , reasons for referral , and the nature of the 
referral process {pre'-refarrai interventions^ alternative referral 
systems ) . Chapter 2 examines implications^f or p the 
need for specified reasons for referral and f of training t^acher^ in 
pre-ref erral^ntervention and viewiTig behavior within its contexts 
Chapter 3 su^arizes research oh t{ie numbers and types of students 
referred, and notes that student sex ahd_ teachers ' tolerance of 
certain behaviors have impact on referral decisions. Sii specific 
question^ are addressed in a chapter oh why teahers refer studehts 
for psychoeducatibhal evaluatibh. Questions touch oh such issues as_ 
ihstitutiohal constraints and external pressures^ characteristics of 
referring teachers^ and changes students tniist make to remain in the 
mainstream setting. Research bn the referral process itself reviews 
procedures in existence and notes such alternatives as the use of 
local norms and of specific interventions within the class before the 
student is evaluated. A final chapter stimmarizes the data sources ai^d 
research procedures used in the studies , including surveys of spscial 

education directors , lonaitudinal studies oiE decisionmaking , case 

study investigation , instructional time qbserva , and comparative 

studies of referral and pre-ref err'al procedures. (C£) 



*********** 



r***********************************ir**************** 



* Reproductions supplied by EORS are the best that can be made * 

* ' from the original document. * 

*********************************************************************** 



EKLC 



A 



U!) University of Minnesota 



, Research, Report No. 141 



REFERRAL RESEARCH-. AN INTEGRATIVE SUMMARY OF FINDINGS 

• ^ * • - ' ■ • " 

Martha L, Thurlow^ Sandra Cftristshson, and James Ysseldyke 



.. .... ■ .vr.. i..r%.;j:K-^ 





Director: dames E, Ysseldyke 



The Institute for Research on Learning Oisabfllties i^s supported by 
a contract (3dd-80-0622) with Special Education Programs^ Department 
of Education. Institute investigators are conducting research on: the 
assessment/decisidn-makihg/intervention process as it relates to learn- 
ing disabled students. 



During 1983-1983, Institute research focuses dri fdur ma.ior areas:- 

• Referral 

• I dent i fication/Classi fi cat ion. 

i Intervention Planning and Progress Evaluation - 

r 

i Oiitcdme Evaluatidn 

Additional ihfonnatidh dh the Insti tute ' s research objectives and 
activities may be obtained by writing to the Editor at the Institute 
(see Publications list for address). 



The research reported herein was conducted under gdvernment spon- 
sorship. Contractors are encouraged to express freely .their pro- 
fess iona*l judgment in the conduct of the project. Points pf_y1ew 
or opinions stated do not, therefore^ necessarily represent the 
official position of Special- Education Programs. 



Research Report No ; 141 



REFERRAL RESEARCH: AN ' I NT EGRAT I VE J.UMMARY OF FINDINGS 



Martha L. ThUrldw^ Sandra Chr istenson , and James Ysseldyke 



Institute for Research on Learhihg Disabilities 
University of Minnesota 



\ 



V 



September, 1983 



4 



i^c Icnaw-lexigme n t: 

This intoqranvo suimiary of tRLH resoareh bh referral wo^ 
rnl Kibnr.it i ve endeavor hy numerous indiviHtnils. Althouqh we 'Ctihhot 
ituMiMnn all who f^elped by name, we must qive s^^ecial ackhbwl edqmeht to 
Marqarot Potter and Bob Pianta who worked on the initial brqahizatibh 
and covOT'aqo of tfie summary. 



Chap tor 1 
nvorview of IRLH Referral Roso^lrcM 

nvor (i six-year pnrid<l, the ihstitiito for Research on Learninn 
nis.ihi lilies (IRLD) at the llhiversUy of Minnesota has conducted 
rpsearch oh issues in the assessment and ijio^nt i Meat ion of learning 
flisribled students. AUhouqh initial IRLD studies concentrat^t^! the 
types of assessment devices beinq used and the differences hetween 
learninf] disabjed students and other students, we consistently were 
faced with evidence of the: importance of the initial decision to refer 
a student for a psychoeducatiohal evaluation. Our attention turned to 
the referral process: Who is referred? Why do teachers refer 
students? What is the nature of the referral process? 

This report describes the results of IRLD studies that provide 
information on the referral process Vt) today's schools. Findings from 
separate studies have" been ihteqrated to address ma.ior issues and ta 
produce recommehdatibhs for practice that are based on research 
results. The studies from which the findings and recommendations were 
derived used a variety of methodologies. Included among these were: . 

• surveys and interviews 

• Comparative studies 

• Longitudinal case studies 

• Psychometric assessment of students • 
% • Simulation of decision-making process 

• Instructional time observations 

• School record reviews 

Hi5 iqhts of Major, indirvis _^ 

The major questions that we 'asked and the maibr findings are 
presented here in very' brief form. Implicatians of the findings for 



pract. rce dm Hlseiissed in Chapter 2, Details of the evidence that 
<:ijpports the Findings are presented in Chapters 3-5. Inforfriatibh oh: 
the dl* sources and specific research prdcedtires are presented In 
Chapter 6. 
• Who Is Rfrf erred? 



1. How many chfldren are referred?. 

a. Classroom teachers refer, on the average^ about three 
students annuaf-ly. 

i_ ; 

b. On the average, about S% of elementary students are 
referred annually. 

c. Referral, rates vary according to location .and referral 
procedures. 

2. What are the characteristics of referred students ^ompa^d to 
non-referred students? ' 

a-. Students referred for psychoeducational evalua'rion ana 
tSose labeled as learning disabled are described 
differently from non-referred or hon-labeled peers by 
both regular and special edocatibn teachers. 

b. Students referred for special education cannot be 

differentiated 'from hdn-referred low achieving students 
on traditibrial psyehbmetrie measures; however, data 
reflect! hg classroom performance (i.e., direct measures) 
do discriminate the students. 

3. Odstudeht characteristics bias decisions made during the 
referral process? * 

a. Oecisions to fefer are Influenced by ^the student Vs sex 
and whether the studgnt has an older sibling who has 
exhibited school problems." 

b. A teacher's tolerance for certain student behaviors 
influences the teacher/s prognoses for student progress; 
low tolerance for a behavior inay increase the 
likelihood that.'students exhibiting that behavior 

,will be referred. ' * 

c. Student prpbl ems ident If i^ referral unduly 
influence educators ' ' placement decisions. 

\ 
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y^iv fio- teachers^ 



4; What In^Htational constraints and etterna^ pressures 
irifVaence teachers* decisions to refer students'^ 

a. institatlbnal constraints limit, the number of students 
referred for jjsyehbeddeational evaluation more than 
external pressures increase the ntirnber of students 
referred. 

h. School districts' variability in implement inq the 
assessment to placement process influences teachers* 
decisions to refer. 

5. What are the characteristics of referrihq teachers? 

' a. Teache^^s report that certain "teacher y?-iables" 
influence their decisions to refer students for 
psychoeducritidnal evaluation. 



b. No consistent relationship exists between several 
teacher characteristics and teacher referral rates. 



6. What are the most comnon reasons for referral? 

a. Primary reasons for referrals relate to low academic or 
behavioral performance in the classroom, 

b. Poor academic performance does not ensure referral; in 
some cases, students must demonstrate behavioral 
difficulties before they are referred for low 
achievement. 

7. To what do teachers attribute referr^^d students* 
diff ieultfes? 

a. Students* school difficulties rarely. are seen as 

resulting from an interactibh of child characteristics, 
teacher characteristics, and school characterfstics; 
they are attributed pr1rnari>y to student or 'home 
characteristics. 

Jd. Special education teachers are somewhat more like! v to 
identify scKddl factors as the cause of problems than 
classroom teachers. 

c. Emphasis on the competence of a student may alter 
teachers* attributions for a student's problems. 



8. .Whait do teachers desire as an outcome from referral and 
assessment-procedures? * 

a. :Hhen teachers refer students, they generally want 
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a5sist?.iee from special education suppdrt staff. 
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• b. Te3cHe>s seem to have miicH less desire. for educational 

sugcjest'iGris than they do for student placement, but this 
may be a result of their previous experiences with the' 
referral system. 

9. What charlges must referred students make to remain In the 
mainstream class'^ddm structure? 

Teachers most often Iriillcated that referred students . 
heed to make task readiness changes involving student 
preparation and receptivity to ^earning to fit vfithin 
their classrooms. 

What is the Nature of t he Referral ^^rocess ? 



10. What pre-referral intervent ons do teachers use? 



a. Use of pre-referra1 int-r-ventiQns is variable; it 
^ rr-irely occurs as part of a formal referral process. 

, b. .^chers report attemoting several pre-referral 

interventions; however, the interventions appear to lai:'< 
syste'^'^at ic implemehtatioh . 

11. Who typically makes' a referral? 

a. Classroom teachers most of ten initiate the referra'^' for 
special education consideration. 



b. Typieall/, a specif ic. fbrm'_is completed by the refe^^'^inq 
teacher to initiate the official deci si on -making 
process. 

12. Who typically receives referrals? 

a. The. individual respdhsible for accepting referrals 
varies among school districts. 

b. The competence of the individual accepting the referral 
is_a critical factor in whether teachers deciiie to 
refer a student, 

13, What happens when a referral is made? - 

a. Although variabil ity across school districts is great, 
in yaneral there is a high probability that once a 
referral ismade the student will be evaluated and 
served in special education. 

b. TheJ?eferral-to-placement process is lengthy. 



c. student inf ■jrrnatibri dh ret-; raV ^orms ff'fectS'^ - 
assessment devices selected, detej^minatibh of 'the., 
student's. pi acemeht category^ and teacher expectations 
for" the student. 

d. School criteria for el igib^nty influence eliqibiiity. 
decisions; different students are identified as eliqible 
for services when different criteria are applied. 

What are 'the effects of using an alternative system of 
referral? 



a. The use of data-based procedures, employing local norms 
with a 2-3 times peer discrepancy criterion^ is a viable 
alternative to traditional teacher-initiated referral 
procedures • 

b. The use of a pre-referral intervention system, wherein' 
regular c1as-sro'om; teachers are assisted in finding ways, 
to help problem students in their classrooms^ is a * 
viable alternative to traditional referral procedures. 




Chapter 2 
icatidhs for Practice 
Several sdec^fic irtipl icat ions for educators can be derived from 
the research findings sunmarized in tin's report.' Firsts reasons 

for referral must be delineated and specified. General and subiective 
reasons (e.g.,, "Door attitude") must nbt be accepted as indicative of 
the need for a student to be given a psychoeducational evaluation. 
Specific referral reasons are essential for planning appropriate 



assessment and intervention strategies* Important information can be 
obtained by describing both (a) studt^nt beSj^ior, and (b) teachers' 
knowledge about, attitudes toward^ and tolerance for the 
characteHstics and bSavlors represented in the referral reasons. 

Second, preservice and inservice training must emphasize more 
than characteristics of specif ie '/kinds" of students. In fact, this 
emohasis in isolation may be perpetuating the view that sbmethihq is 
wrong' with the child. The interaction between the student and 
educatidrial setting must be characterized'. Therefdre^ training must 

_ ._ _ _ _ _ . 4 ' - 

be brbvided in assessing and ddcUmehtihg classroom ecdldgy variables 
that influence bdth student and teacher behavior. 

third, identifying single causes for a student's difficulties may 
be very inaccurate etnd/or incomplete, linear thinking (e.g., there is 
a cause and a solution) appears to be common. Teachers must be 

trained to adopt a systems approach, in which behavior is viewed within 

_t_ 

the context in which it occurs. Without an ecological _^erspect1ve, 
teachers may continiip to suffer from "teaching helplessness"; that is, 
their efforts may seem unimportant because they cannot influence a 
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student ^dse difficulties 3re ^ attfibuted to' a ?ing1^, stable-^ 
internal cause (e.g,^ %tudent*s ablHty), 

Fourth, although teachers deserve credit ior atteniptiriq 
interventions prior to seeking additJonal services for students, their 
pre-referral 'interventtons- too often are unsystematie and Idclcirig in 
accountabi 1 i t^. Regul ar educators deservS training and consultation 
to help them plan pre-referra1 interventions that ut i 1 i re' systematic 
principles of learning (e^,g-,: practices appropriate level of mS:erial) - 
and that aif^e^ accountafcril i ty standards. Such procedures would provide V 
a data bast for- future assessment decisions whitp concurrently 
ass^isting the classroom teacher. • , ' , 

Fifth, an ^tti tude. change regarding referral outcomes^is needed. 
There appear to be "blUrred boundaries" between \ refi^rral • and ; 
assessment. Tt seems that educators comply with PL 94-142 by looking 

. / >v _ __ _ : it __ ^ _ _^ 

for specific student characteristics to .iustify referrals^ and ^at ^ 

referral mecirrs automatic assessment of the^student. Educators seem to • 

believe that the only suitable 'intervention is special education 

placement. However,, mainstreaming . is. a reality for handicapped 

children. In fact, mildly handicaDped students spend a higher 

proportion of their school- day in mainstream cjassrboms than in 

resource rooms. Referral does not. automat veal ly alleviate the .Regular 

classrooni, teachers' problems. 'Shlld study^ teams must provide 

accountable instructional straterj^'es for any teacher referral; marry of 

_ . . "■_ _ *. .. ► 

these referrals could be handled without formaT diagnostic^estlnq. 

Sixth/ teacher exbectatibns for the student role in the learning* • 

process* (mdti vation\, willingness to try) should be explained to 
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8 , ' 

students and parents* Further^ preservice ahct inservice traiiiinq fdr^ 

_ _ ^ . . - - ^ . - . ■ ■ ' - \- 

teacHers on how to chanqe student behavior sHould occur. Too often 

change iri beKavidr is demanded . and expected immediately (an event); in 

real ity^ .Change in students is a process, teachers should be providecj 

' with Help in achievinq progress in this process, / 

We/ as educators^ may have lost sight of the real reason for 

re^ferra], ti)^( of ittstructional planning , Tt aopears that a teacher 

-who refers a student desires special education placemerrt, and that 

- \ -I- > . - -- . 

intervention tias been mi^i'nterpreted as placement. Special education 

placement is only one type of intervention and it is not the sole 

solution to the classroom teacher's concern; Therefore, rather than 

ooerating' in a ref erral-to-pTacement oaradigm, school systems must 

discuss and implement ref erral*-to-interventidn paradigms. This 

systems chanae would not preclude assessment entirely, although It 

should reduce the number of assessments for cases in wh-ich the 

teacher's concern could be solved within the classroom through 

behavioral consul tation. 

two alternatives to typical referral procedures were examined in 

this report. One alternative involved the continuous monitoring of 

student performance on di*rect academic measures. When a student 

continues to perfoV-m poorly oyer a period of time on these measures, 

that student, is referred for a psychbeducatibnal evaluation. The 

.^econd' alternative involved the requirement that systematic 

instructional interventions be implemented in the regular classroom 

before a referral for psyeHbeducatibnal evaluation could be made, the 

research results indicated that each alternative eliminated several of 

: \ 13 ^. . 

* I — -.^ 
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the problems (such as teacher bias, high prbbability of placement 
fdllowihq referral) a^sociatSd with typical referral prbcedbres* 

Alternatives to - current practices in referring students * for 
psych.deducat iorlal evaluations must be explored further. Alteri^ati.ves 
could be designed not only to increase the apprdpriatehess of special 
education placemefitSi but alsd td avoid unnecessary placements, -^f 
course^ when addressing ways in which to change the referral prdcess^ 
one must recognize that referral is a complicated process^ It is 
influenced by student, teacher, and school system characteristics, 
which in turn are influenced by. legal, social, and political issues^ 



» . / 
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BhajDter 3 , 
Who Is Referred for PsychbedUcatibhal Evaluatidn? 
This chapter surmiari-zes IRLf) research findings related to the 
issue of who is referred for psychdeducat ional evaluation, three 
soecific questions are addressed in this chapter: 

• How many children are referred? 

• What are the characteristics of referred students compared to 
non-referred students? 

• Do student characteristics bias decisions made during the 
referral process? 

For each question, the major findings are summarized and the data 
sources f om which the findings were obtained are 1 isted (generally 
ordered in terms of recency). Specific evidence for the ma.ior 
^findings then is presented. 
How-Jdan^- -Children Are Referred? 
Findings: : ; 

a. Classroom teachers refer, on the average^ about three 
students anriuany. 

b. On the average^ about 5% of elementary students are 
referred annually. : 

c. Referral rates vary according to location and referral 
procedures . ' 

Data Sources: 

• Surveys of classroom teachers (RR 58^.91^ 

• Survey of special education directors (RR 103) 

• Comparative study of referral procedures (RR 75) 

Evidence: ' 

In one teacher survey (RR 91), teachers reported an average of 
2.2 stiidents referred during 1977-78, 2.4/ during 1978-79, and 3.B 
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ddririq 1979-;89, .In another teacher survey (RR 58), an average of 3.9 
students per teacher reportedly were referred during the l98d-8l 
school year. Special education directors (RR 103) indicated that an 
average 5% of elementary students were referred during the three 
school years 1977-1980, Vet, one director reporte;! 0^ while andtfrer 
reported 30%. 

ReferraT rates Vary greatly. Large differences have been found 

as a function of geographic area as well as a function of the referral 

procedure. In a small town cbmmuriity in the^midwest, where teachers 

were required to implement arid dbcumerit iriterveritibris before referral, 

a low referral rate (1.8%) was observed (RR 75). This rate was lower 

than that resulting from an alternative referral procedure that 

involved testing students on direct academic measures (2.4%). 

What Are the Characteristics of R^fari^ej — Students -Compared to 
Nbri-Referred Studerits? 

Findings: . ' 

''a. Students referred for psychdeduc§tional evaluation and 
those labeled as learning diS'abled are described 
differently from non-referred or npn-labeled peers by 
both regular and special education teachers. 

b. Studerits referred for special education cannot be 

dif f ereritiated from non-referred low achieving students 
on traditibrial psychbrrietric measures; however, data 
: reflectiriq classrbbm perfbrmarice (i.e., direct measures) 
seem tb discrimiriate the studerits. 

. / . ' 

nata Sources: / 

• Survey of classroom 'teachers /RR 91) / 

• Hirect measure assessment of low acHq^vers (RR 71) 

• Survey of special education teachers/ (RR 66) 

- ' - - ^ / _____ 

' Psychbmetric assessment of low achievers (RR 13) 
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Evidence: 

Regular . education teachers perceive students whom they have 
referred as being different from other (non-referred) students in 
W their reading groups in terms of speed of learning, motivatidni 
maturity^ and judgment (RR 91). Referred students consistently were 
rated as poor or very poor relative to their peers on these 
characteristics, whereas they were not rated consistently as poor or 
very poor in terms of their ability to learn or their ability to 
behave. Overall, most teachers felt that referred students did not 
function well within the group and were not typical of other students 
in the group. Further, most teachers indicated that for the referred 
students to fit adequately into their classrooms, the students would 
have to change their tasl< readiness behaviors fe.g.^ finish work, pay 
attention, follow directions). Yet, the reasons teachers gave for 
' referring these students most often were for learning-related or 
emotional ly-manifested problems. - , 

LD teachers often describe the characteristics of referred 
students who are diagnosed as LD in terms of processing, memory, and 
attehtibhal diff icul ties^ poor academic achievement, and some type of 
discrepancy in their performance fRR 66). Yet, comparisons of Ibw-i 
achieving students who are not referred by their teachers with 
students who are referred and served, in bO programs reveal few 
differences of practical utility between the two groups on 
psychometric measures typic^-^lly used to justify their classification 
(RRl3). However, data that more accurately reflect typical classroom 
performance (such as direct measures of reading^ soelling^ and written 



exjDression) more dften diserimiriate the two groups of students (RR 
71). 

f3o Student Characteristics Bias Decisions Wade During the Referral 
Process ? 

Findings: 

a. Ol visions to refer are influenced by the student's sex 
and whether the student has an older sibling who has 
exhibited school problems. 

_ I ■ 

b. A teacher's tolerance for certain student^ behaviors 

influences the teacher 's proqnosjes for student progress; 

low tolerance 'for a behavior may increase t^ ' ^ 

• likelihood that students exhibiting that behavior 
will be referred. 

c. Student problems identified in referral unduly 
influence educators' placement decisions. 

Data Sources: 

• Surveys of classroom teachers (RR 29, 39, 91) / 

• Case study investigation (RR 74) 

• Comparative study of referral procedures (RRpf 75) 
•Survey of special education directors (RR 60) 

• Decisidri-makirig, simulatibh. study (RR 18, 26^ 32^ 33^ . 34) 

• Disturbing Behavior Checklist validation study (RR 8) 

Evidence: 



Regular classroom teachers refer approximately 2 1/2 times more 
boys than girls. When traditional referral procedures were examined 
(RR 75 j 4 80^ of the students referred by teachers were boysL. In 
contrast, when direct measures were used to identify those students to 
be referred, only. 665^ were boys. Boys were referred for behavior ' 
disorders relatively more often, than girls, and teJchers wanted 
special education placement ' and help outside of school (cdUhselingi 
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private tutoring) relatively more often for boys' than they did for 
girTs ((^R 91). Also, teachers used behavioral strategies (charting, 
contingency contracting) as pre-referral interventions more with boys 
while they used structural interventions (peer tutoring, seat change^ 

grouping change) more with girls. 

___ _ • _ _ ' ~ ~ ~ ---- 

Regular class students who have older learning disabled siblings 

are expected to do relatively less well than students who have older 
siblings who are regular students fRR 29, 39). Teachers expected 
3ifferences in saeh areas as reading level , general knowledge. Visual 
and/or auditory perception, and rrembry skills.; Ch'ldren who had older 
tD siblings also were expected to make less progress during: the year 
and to need more support services than children with non-LD siblings- 
Teachers indicated different prognoses for students exhibiting 
different behaviors; their prognoses were a direct function of their 
tolerance for those behaviors. Teachers not bothered by student 
behaviors held higher expectations for a student than did teachers who 
were bothered by the behaviors. Thus, the extent to which a 
particular teacher finds a particular type of behavior as disturbing 
may Influence the likelihood that a student exhibiting that behavior 
will be referred (RR 8^ 74). The idea that mismatches between 
students and teachers influence referral practices appears viable. 

The nature of ^^actbrs that influence teacher referrals is 
important since the decision to refer a student plays a strong role in 
other decisions made aboift that Itudent. For exaffiple, on the average, 
the student who- is referred is likely to be. assessed and placed' in 
special education (RR 60) y an occurrence that reflects- the finding 

19 
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that cieeisiori makers in general place extremely high va^lue on problems 
identified in referrals, even when assessment data indicate completely 
average psychometric and observational scores (RR 18^ 36^ 32^ 33, 34). 
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Chapter 4 
Why fDd Teachers Refer Students? 
' this chapter summarizes IRLD research findings related to' the 
issue of why tochers refer students for : 'choeducalional evaluation. 
Six specific questions are addressed in this chapter, 

• What institutional Constraints and external pressures 
influence teachers' decisions to refer students? 

• What are the characteristics of referring teachers? 

. 

• What are the most common reasons for referral? 

• To what do teachers attribute referred students' difficulties? 

' What do teachers desire as an oatcome from referral and 
^assessment procedures? 

• What changesmust referred students make to remain in the 
mainstream classroom structure? 

For each . question, the major findings are summarized arid the data 

sources From which the firidirigs were obtained are listed (generally 

ordered in terms of recency). •Specific evidence for the- major. 

firidirigs theri is preserited. 

What Institutional Constra ints and External Pressures Inf luence _ 

Teachers' Decisions to Refer Students? „ 

» 

Findings: 

a. Institutional constraints limit the number of students 
referred for psychoeducatiorial evaluation more than 
external pressures increase, the number of studen€s 

referred. 

. - ' 

b. School districts* variability in Jraplemerit jrig: the 
assessment to placement Process i*rifluerices' teachers* 
decisions to refer. 

Data Sources : . ' ' 

• Survey of classroom teachers (RR .58) 

• Surveys of special education directors (RR 14, 6G) 
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Evidence:' ; 

Regular education teachers (RR 58) indicated that orgahizat ibrial 
factors (e.g., ijules; procedures^ guide! iries)^ availability of 
services, and "hassle" (e.g.^ paperwdrki meeting tiineV were the 
greatest .barriers to referral (although 21% said there were no 
barriers) , and that outside agency influence, federal or stated 
requirements, and concerns of parents were the most common external 
Pressures ,for referrals (although 70^ said there were no external 
pressures). These same teachers generally estimated the probability 
of a referred student being placed as very high. Yet, they expressed 

____ _____ :_____:______ _____ UV_____ 

skepticism about the payoff of the team decision-making, process. 
Special education directors (RR 14), nbtirig difficulties with the. 
decisibri--mat>iri^ prbcess, reiterated teachers' cbncerris abbut length bf 
time from referral to team decisibri iriaking. Iristitutibnal cbnstrairits 
influenced teachers' referral decisions to a greater degree. 

The ease or difficulty with which referred students move through 
the assessment to placement process also seems to influence the extent 
to which teachers refer studehtSv Although soecial education 
directors indic'ated that an average of 92% of referred students are 
evaluated and that 73% of those evaluated receive special education- 
services (RR 50), variability is great, with the percentages of 
referred students evaluated in different school districts' ranging.from 
39% tb 100% and the percentages bf evaluated students placed ranging 
from 10% to 100%.' 
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5; Mhit kre the Characteristics of Referring Teachers ? 

Findings: " " 

a. Teachers report that certain "teacher variables** 
influence their decisions to refer ftudents for 
psychdeducatibrial evaluation, 

^. b. No consistent relationship exists -^between several 

teacher characteristics and teacher referral rates. ^ 

Data Sources: 

• Surveys of classrddrn teachers fRR 53^ 91) 

Evidence: 

Almost all teachers make referrals at some time, but the 
frequency with which they do so varies^ considerably. Teachers 
themselves have suggested that certain "teacher variables" inhibit or 
facilitate' the tendency to make referrals fRR 58). Teacher Skepticism ^ 
about the payoff of the process most often inhibited* referral . The 
teacher's belief system, knowledge of individual differences* 
willingness to modify the curriculum, arid tolerarice all were| 'said, to 
have an influence on a' teacher's referral rate* suggesting that 
teachers who are willing to modify the curricuTum and who are tolerant* 
of various behaviors, for example* are lass likely to refer students- 

Analyses of data from classroom teachers making • actual referrals 
of studerits for psychoeducational evaluation (RR 9i) did not reveal 
any consistent: relationships among several traditional teacher 
variables (age, sex, experience, etcJ 'Snd the numbers of students 
theV had referred in previous years. Furthermore, there were rib 
consistent relationships between referral history arid such variables 
as reasons for referrals, attributions fbr studerit problems, and 
desired outcomes of referral. 

! 
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5 . What Are the Most eommon Reasons for Referral ? 

... 

Findings: . \ 




behavioral performance in the elassrdbm. 



b. Poor academic performance does not ensure referral; in 
some cases, students must demonstrate behavioral 
difficulties bofbre they -^are referred for low ' : 

achievement. ' - - 

Deta-Soyrces : 

- Survey of classroom teachers (RR 91) 

• Gomparative study of referral procedures fRR 75) 

• Longitudinal study of decision making (RR 44) 

• Instructierial time bbservatibhs fRR 95) 

Evidence: 

Teadhers ruost often say they refer students because of classroom 
difficulties reflecting either learning-related problems (specific 
learning deficits, below grade level perfbrmante) or . emotion al ly- 
manifested problems (poor^ school adjustment, pobr self-concept, 
immaturity) (RR 91) • hearning-related reasons 3xceed reasons related 
tb erbtibhal factbrs. 

Selected case studies uorrbbbrate the survey results. Of 11 
students who were observed as they proceeded through the referral^ 

assessment^ and placefnent process (RR 44, 95)^ academic" difficulties 

_ y _ _ _ ^ : _ _ _ . _ . _ 

were lis ted in a/i 1 of tjie students • written referrals. Emotional 

/' * ' 

and/or behaviora^l problems also were noted in four of the referral 

statements. ^^ditional reasons fe.g., snort attention span) were 

(fiveh in two pf~these. r ' 

Similar numbers of students', are referred by teachers as are 

referred b'y a procedure in which their performance is • assessed using 

/ 
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direct academic measurb fRR 75). 'Hdwever, teacher-ref erred stadehts 
are ;iibre likely to be rated as having behavior problems; Again, 



m 



1 smatch between stjidents and teach2rs may i nf 1 uence referral 



' practices, 

7 . To What Do Teachers At-. tr ibuto Referred Students ^' Diff ical ties ? 
Findings: ' ' , 

a. StuUenis* school difficulties rarely are seen as^ 
resulting from an interaction of child characteristics, 

« teacher •characteristics, and school characteristics; 
- they ore attributed primarily to student or home 

characteristics.' ' 

b. Soecjal education teachers are somewhat niore ltkely to 
identify school factors as the cause of problems than 
classroom teachers. 

c. Emph'jsis oh the competence of a student may alter 
teachers* attributions for a. student's problems. 



Oata Sources: 

• Surveys of 'classroom teachers (RR 29^ 39, 91) 

• Surveys of special education teachers (RR 43, 66)_ 

• Ease study investigation (RR 131) 

Evidence: 

Over 59% of the causes of students' problems that were listed by 

referring teachers could be categorized as with ;n-st»udent causes 

(e.g., bir^th defects, low pbtenti al )^ and over 35« could be categbrized 

as home causes (e.g., divorce^ family instability! (RR 91). Less t>ah 

3% of the causes listed were related to teacher or school facfetrs. 

Regular class teachers reacting to case study reports also tended to 

provide ''dtherrdirected" .attributions (student or home) for student 

1 

difficulties (RR 131). Similarly, teachers of tB students most often 



identify ' student inabilitj'es (5856) or problems wUhiri the 



home 
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,;^_envi^ as the reasons for learning disabilities (FTR, 66); - 

However i these^ teachers .more often than regular educators ^attni bated • 
the*" clisabil ities to some kind of failure on the part of the school 
" (18%) usually to' inadequate regular education t^eachers or curricula. 

When asked about the etiology of learning disabilities', twb' , 

groups of regular education teachers most of.ten indicated that 

' # * - • — * -« 

environmental .factors were the cause (RR 29, 39). Medical, 

hereditary, and combinations of causes were cited mucfe less 

frequently.* Of course; environmental causes include wi thin-student - 

problems and home problems, as well as teacher or school problertvs. 

, * Special education teachers who had observed a student's v 

; performance and reviewed information about the student indicated 

/ < _ _ _ : _ *f 

/ different attributions for students portrayed in different ways. *Th'e 

_ ___ _- 

student's performance -was attributed more to task diff iculty^nd ^ 

effort and less to chance when the student was represented a^s a nfore 

competent student. Performance of an ED child w^is attributld mre to* ^ 



effort than was. performance of an LD child . , . 

(RR- 43). ^ • . 

• _ • . 

8. What do Teachers Desire-^S— JTiutcorne from Referral and. Assessment : 

Procedures? S - " 



Findings: . ; 

a; . When teachers refer students, they" general ly want ^ 
' assistance from special educatibg support staff. ^ 

- _ _ ' __ -_ J _ * - - . . 

*b. Te"achers* seem to have much less desire for educational 
i st|_gyestions than they do for-rtudeht placement, but_^is 
ma^.be a result of their previous experiences with the 
ref.erral system. . • • . 

- _ - ' . ' • / . - } . 

Qata Sources: ' - * • ' 

• Surveys of classroom teachers (RR Ba, 91) . , . 

... ' * * 

• » -. ' 
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Evidence?: 

When -tctd.cHers refer students » most df the reported desired 
out corner (66%) Were for placement or p jacernent-i*&lated activttie^ 
(assessment, decision makSngl to occur (RR 91). -^'Sires for 
educationat suggestions or help for the student were mentioned with 
much less frequency ^25^). As 3 result of r3ssessment> many (40^) of 
t^»ese safTTEe teachers Wanted placement .of the stadent. Desires for 
eriuc^Uonai stigqesHdhs *^rom assessn^eht ressjtts were rnenttoned by 
?3bn ■ '^^f of the teachers, 

TeacHers' asked'' to rdent>fy factors that rnhibU^d decisions to 

refer students frequently hated the lac^c of educational suggestions 

for sjse the classroom fRR S3K I'his^ In tUm^ seemed to be 

reflected \o the^r .t?el ^ef* that the payoff for referra? is Vow. Tt my 

be Vnat tecKhers who refer students ind^c^te that they want the^n 

pMced tr siiecta! educattoh because ewerier\ce has shown ^th^M that, 

this is aUnost al?^ that wTH happen. 

at Changes ^ '^ust Referr e d Students Mafete to Regain in t^e Ma4^^trg)^a^ 
Elassrbon Str ucture? 

Findings: • 

Teachers most Of ten indicated 

need to make tasic readiness changes Inyol'^lng student 
preoaration an^ reGeptlvUy to learning to fjt within 
their classrooms, 

Oata Sources: ' - 

• Survey 6? classroom te&chers (RR 91) • 

Teachers reported that task readiness changes (fthish wbrk^ bav 
attention^ follow; directions) were 'the most important ones that 



?3 

i^tudehts needed to make; academVc changes were desired Half as often 
91h TasR readiness changes were indicated regardless of whether 

the primary reason for the student referral had been a learnings 

- _- - ^ - i 
related or an e-nbt ibhaMy-mani fested one. 
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Chapter 5 

What is the Nature of the Referral Process? 

this chapter summarizes IRLO research findings related to the 
issue of whai happens during the referral process. Five specific 
nuest^ons are addressed in this chapter: ^ 

" What pre-referral interyentions do teachers use? 

; Who typically makes a referral? 

• Who typically rece^ve^ referrals?, 
What happens when a referral is made"^ 

• 'What are the effects of .using ah aHernafce system of referral? 
For each qiif?stibh, the major findings are summarized arid the data 
sources from which the findings were obtained are listed (generally 
ordered in terms of recency). Specific evidence for the ma,io> 
findings then is presented. 

What Pre-Referra^ Interventions Do Teachers Use ? 
Findifiqs: 

. Use of pre-referral interventions is variable; they 
rarely occur as part of a formal referral process* 

Teachers report attempting several p^ 

interventions; however ^ the interventions appear to lack 

systematic implementation. 

Data Sources: 

• Survey of classroom teacher^s fRR 91) 

• Longi tudincil study of Hecisidh maicihg (RR 44) 

• Survey of special educatibri directors (RR 14) 

_ _ _ - ' 

Evidence: 

less than 5*^ of the special education directors included any kind 
of pre-assessment interventions as part of the referral process (RR / 
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14). Teachers who had referred students for psvchoeducat Idnal 
evaluations, on the average^ reported that they had tried about 3 
different interventions before the referral was made fRR 91). Most 
often, the pre-referral Interventions involved changes in methods, 
including individual attention, curriculum adjustments, and attempts 
to orient the student to the task. Only a small oercentage of all the 
interventions attempted resulted from consultation with another 
individual. When someone was consulted, it most often was a special 
education^ teacher or a principal. Almost none of the interventions 
reflected psychological learning principles. Further, few teachers 
meritibned a specific period of implementation or evaluation of the 
interventions. 

Interviews of educators indicated that the extent to which 
specific interventidns are attempted dridr td referral is highly 
variable; some teachers made nd attempts at pre-^ref erral 
interventions, others made minor, materials and structural changes, 
while one made very specific changes based on behavioral observations 
of the student in the classroom (RR 44). In almost all cases, the 
teachers* attempts at classroom modifications or other prerreferral 
interventions were not evaluated as part of the decision-making 
process. 

Who Typically Makes a Referra l? 
Findings: 

a. Classroom teachers nibst often initiate the referral fbr 
special education cbhsideratibn. 

b. fybically, a sbecific fdnrj.is cdmpleted by the referring 
teacher tb initiate the dfficial decisidn-making 
process. 
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Data Sources: 

• Surveys of classrfflJrri teachers fRR 58^ 91) 

• Longitudinal study of decision making (RR 44) 

• Survey of special education directors (RR 141 

• Survey of model LD programs (RR 11) 

Evidence: 

When describing the steps in the assessment and decision-making 
process, about 75% of the directors of special education associated 
the teacher, with the referral step; when parent referral was 
mentioned, it was only in conjunction with a teacher referral (RR 141. 
Simi larly, over 50^ of the model programs for Lt) students (CStlCs) 
associated the referral step with the teacher (RR 11). Both the 
special education directors and CSDCs included teachers spontanedusly; 
they had not been asked to identify who could make referrals. Tn the 
observation of actual student cases, it was found that even when the 
parent was the person who first expressed concern with a student's 
progress in school, the teacher had to be the one to make the referral 
before the school would act on it (RR 44). the teacher typically was 
required to fill out a brie-page form that asked for student 
informatibri, the reasbri for referral ^ and an indication of whether the 
parent(s) had been contacted, teachers had indicated that the kind of 
referral form used by the school affects the extent to which they are 
willing to make referrals (RR 58). When regular education .teachers 
were asked to indicate the appropriate time to make a referral, most 
responded either (a) when the student was not fuhetidriiriq, or (b) 
during the first tritnester of the school year. Few teachers indicated 



31 



ERIC 



27 

that the studeTit should have been not functioning (a) over a period of 
time, or (b) despite the teacher's modifications. 
12. Who Typically Receives Referrals ? 
Findings : 

a. The individual responsible for accepting referrals 
varies among school districts. 

b. The competence of the individual accepting thereferral 
is a critical factor in whether teachers decide to 
refer a student. 

Data Sources: 

• Survey of classroom teachers (RR 58) 

• Longitudinal study of decision maRing (RR 441 

• Survey of special education directors (RR 14) 

Evidence: 

In identifying steps in the assessment 'and decision-making 
jDrbeess, only 37% of the special education directors mentioned a 
formalized brbcedure for reviewing a referral before assessment was 
initiated (RR 14). Observations of actual referral cases indicated 
that child study teams^ school social workers, special education 
teachers^ and principals were among those to first receive the formal 
teacher referral form (RR 44). some cases these individuals 

automatically passed the referral on to a team who set tip guidelines 
for assessment; in other cases, the person receiving^ the referral 
completed other forms before decisions about assessment were made. 
Regula? education teachers have noted that the perceived competence of 
the person{s) designated to receive referrals has an effect on whether 
a referral is made, as does the extent to which the referral recipient 
encourages or discourages referrals (RR 58). 

. • _ 32 V 
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What Happens When a Referral ir. Wade ? 
Findings: 

a. Although variability across schochl districts is great, 
in general' there 1s_ a high probabi] i ty that once a 
referral is made the student will be evaluated and 
served in special education. 

b. The referral-to-placement process is lengthy. 

C. Student information on referral 

assessment devices selected, determination of the 
student's placement category, and teacher expectations 
for the student. 

d. School criteria for eligibility influeriee eligibility _ 
decisions; different students are ideritif iedas eligible 
for services when different criteria are applied. ^ 

Oata Sources: 

• Surveys of classroom teachers (RR 58, 91) 

• Comparative study of referral procedures (RR 75) 

• Surveys of special education directors (RR..14i 60) 

• Analysis of psychometric assessment data fRR 47) 

• Longitudinal study of decision making (RR '44) 

• Decision-making simulation study (RR 18, 19, 32, 33) 

• Survey of model LD programs (RR 11) 

• School record review (RR 136) 

Evidence: • 
Both directors of model programs for tD students (RR ID and 
directors of special education (RR 14) include the referral step in 
their descriptions of the decision-making process with much greater 
frequency than any ether step except' assessment. Typically, referral 
is seen as the first step in the decisibri-makirig process. FoU owing' 
referral, assessment activities are initiated^ including the 
appointment of an assessment team^ and obtaining parental permission 
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to assess, as well as the actual assessment. Oespite the consistency 
in descriptions "of the process by special education dir^ectors and 
directors' of model LD programs, almost 25% of regular education 
teachers who were referring students reported that they did not know 
what their districts procedures were fRR 58). the amount of - time 
required for the decision-making activities to occur varies widely, 
hut there is often considerable discrepancy between the time when 
concern about a problem first is expressed and the time when the 
assessment is conducted, even though no changes ha8 been implementetf- 
withiri the classroom (RR 44). 

Once a referral for evaluation is made, the student seems to have 
entered a one-way street leading to assessment and placement. When 
asked about the chances that a referred student would be placed^ a 
majority of teachers indicated probabilities that were very high (RR 
58); about 30% responded with a percentage greater than 80^, Teachers 
made such comments as, "There is a 90-100%. chance of a student being 
placed once hefshe] is tested" and "Students are usually placed since 
teachers recognize those who do qualify when the process is complete." 

s 

These comments and percentages are supported by special education 
directors* reports of actual oumbers of referred students who were 
assessed and placed (RR 50). Dn the average, 92% of those students 
referred were evaluated; 73% of those evaluated were placed in special 
education. Variability across districts was great, with one 
evaluating only 39% of the students referred and another evaluating 
all; in one d-istrict only 10% of those students evaluated were placec^^ 
while in another all evaluated students were placed. Overall, slower 
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percentages of students were referred ^ evaluated, and placed in urban 
areas; higher percentages of students were placed in the southern and 
western regions of the U.S. Survey responses of regular education 
teachers (RR 91) indicated that an average of 91^ of those students 
they had referred during 1977-78 were evaluated and 75% of those were 
jDlaced. The average Rercentages for 1978-79 were 92% and 82%;r for 
1979-80^ the average percentages were 90% and 70%. School record 
reviews in^a school district where students are referred by category 
similarly indicated that 72% of the referred students were placed in 
some form of special education, and that most were placed in the 
category for wh^'ch they were referred fRR 136). Thus, the percentages 
calculated on a district-wide basis and on an individual-teacher basis 
are similar and high. y 

Tn some districts, attempts have been made to drastically reduce 
the percentage of students placed fallowing assessment. tn one 
district, a severe deficit criterion for performance on Sne test 
battery was established (RR .47). Of 51 students who were assessed, 
only A7% were placed in special education. Yet when the assessment 
data from these- students were entered into other severe deficit 
criteria^ the same students wePe not identified as eligible for 
services. 

In another school district where a specific severe discrepancy 
^ criterion was used, 44% of a sample of students who had been referred 
by teachers were placed in special education services (RR 75). In the 
same district, only 14% of a sample of students who had been referred 
as a result of their performance on weekly measures of. reading, 
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speniriqi arid written expression were placed in special .edUCatiOri 
services.' Yet^ ho. differences were found between the two groups of 
referred students in terms of cognitive functioning^ achievement 
level* and social behavior. Further* only 36^ of the teacher-referr^^d 
students who were placed in special education met the school 
district*s severe discrepancy criterion. 

Thus, the mere fact that a teacher has referred a student selems 
to influence other decisions made about that student and even 
expectations for the student. School decision mjikers participating in 
simulated decision making predicted differential performance of 
students as a function of information presei^cl in referral folders 
(RR 18, 32, 33). Further, different test data were requested as a 
function of the stated repori for referral (RR 32, 331. Respite the 
fact that all test data provided to the; decision- makers were 
indicative of average performance ^ 51% of the decision makers declared 
the student eligible for special education services; the 
classification assigned to the student in many cases was related 
directly to the stated reason for referral. When asked about the 
influence of various ' factors on their decisions, the decision makers 
consistently rated th§ referral statement of the student's problem as 
having a significant influence. 

Despite the demonstrated importance of the fact that a student is 
referred and the stated reason for the referral, hb systematic 
relationship has been identified between the reason for referral arid 
the types of pre-referral iri^terveritioris that teacher^ implemerit^ what 
the teacher believes the student would have to do to fit within the 
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maihstrearri c\as5rddrri stflictufei or th^ desired outcome of the referral 
m 91). , ' . . 

i 4 . What Are the Effects of Using an f Iter^ia te System of Referra ll 
Findings: 

The use of data-based procedures, employing local norms 
with a 2-3 times peer discrepancy criterion, is aviable 
alternative to traditional teacher-initiated referral 
procedures. 

Data Sources; 

• Comparison of direct measure eligibility criteria (RR 89) 

• Direct measures norm development (RR 87) 

' • Comparative study of referral procedures (RR 751 
' Development of local norms (RR 132) 

O _ __ 

• • Comparative study of pre-referral interveritibris (RR 140) 

Evidence; 

Students referred by teachers and by data-based procedures were 
comparable in several ways (RR 75). First, the Apereentages of 
students referred were similar, with the percentage referred by data- 
based procedures (2.4%) slightly higher than the percentage referred 
by teachers in this study (1.8%). The average grade levels of the two 
groups were the same. Further, no differences were found between the 
two groups in cognitive ability, achievement^ or abil i ty-achievement . 
discrepancies. 

Some important differences were noted between the two groups^ 
however. Referrals of boys were' made much more frequently by. teachers 
(80%) than by data-based procedures {66%). Further, there was a 
tendency for girl^s referred by teachers, to exhibit more school 
behavior' problems than girls referred by data-based procedures. 

4 
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Finally, only H% of the students referred data-based procedures 
were declared -el igible for soecial services by the schools^ while 44% 
of the students referred by teachers were declared eligible. Thus, 
despite the comparable standardized test data for the two .groups, 
decision-making teams seemed to have Been influenced by the fact that 
a referral was made by a teacher, a person who was asking for help. 
Analysis of the standardized test data for students declared eligible 
rpvealed that only 35% of those students who had been referred by 
their teachers andideclared eligible by t}ye schools Actually met the 
severe discrepancy criterion fbf el igibi 1 ity establ ished by the 
schools, whije 80% of those students referred hy data-based procedures 
did so. 

The use of local norms ^or direct rneasure performance- comparisons 
is recomriended. An attempt to develop national norms fRR 87V 
indicated that although student performance showed the expected grade 
differences and improvement within grades, considerable differences in 
average perfonrtance were evident among different locations. A 2-3 
times peer discrepancy criterion appears to identify percentages of 
students comparable to those presently served in special educatibh 
programs (RR 89). Local narms have been developed arid used 
successfully: in at least one large special educatibri cooperative fRR 

: i • ; ./ ' 

Another ^ipprbach beirig stiKiied as an alternative to current 



referral procedures involves t+je systematic* use of specific 

_ _ _ _ . _ _ _ ^ _ _ . _ _ _ _ _ _ . _ _ _ _ I ._ 

interventions within the cl ass before the stude^it is evalu:itted. A 

year-long study of such an approach indicated that ^^hile referral 
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rates for those teachers receiving pre-referraT assistance did drop 
sighif iearitly at firsts resistance to the system erased many of the 
exjDected effects. However, several teachers were able to implement 
the system successfully, thus suggesting its ^ viabil ity. It appears 
that successful implemerrtatidn of the system will require more 
attention to ah attitude away frorti the belief that student learning 
difficulties can be fixed by tesiing^ label irig^ and sp_ecial education 
placement^ toward the recognition that by dealing with student 
problems in'the regular classroon], soecial education placements can be 
avoided and students' instruction can be improved. 

The referral systems described here are but two of several 
alternatives that might be implemented.' Clearly, additional field- 
based research is needed to Identify viable referral s-^stems for 
today's schools. 



Chapter 6 ' 
Data Sources 

This chapter provides a summary of the data sources and. research 

procedures used to obtain the research findings presented in the 

previous chapters; Ah overview of _^the data sources is provided in 

Table 1. The IRhD research reports in which more detailejJ, 

explanations may be found are listed in the table, as are th^ nqpjbers 

of the cbrrespohding research questions. The data sources are ordered 

within this chapter (and the table) according to the frequency with 

which they are cited as sources of evidence for 'various research 

questions. ^""^ 

Survey of Regular Education Teachers Who Had— Raf^r^d— S tudents for 
Psychoeducatiohal Eva 1 oat ions (RR 91) • , 



During 1980-81, lOS elementary regular classroom teacher's 



completed referral surveys at the time they referred students for 
psychoeducatiohal evaluations. Nihety-dne percent of the teacher 

sample was female; the' average number of years of teaching experience 

** 

was 11.4 (range = 1-35 yrs.). The average class size per ^teacher was 

- ,- - - - - 

25 students. The teachers were from 14 public school districts within 

__ __ _ "__ _ _ ^_:*_ _ __ _ ___ « 

10 states distributed across the four reqidhs. of the United * States. 
Suburban, urban, and rural school^ districts were included. School 
district adrniriistrators served as contact liaisons between researchers 
and schools. Principals asked teachers to read a letter- describing 

: '_ __ _ _ _ _ _ ^ _ _ . 

the study at the time they initiated a referral, anji if i'nterestetf-in 
participating^ to complete the survey and return it. directly to the' 
investigators. _ . ' *. 
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Table 1 

_ _ __ _ • . __ . _ 

Referfaf ResearcH Data Sour 





Research 
Reports 




Data Souree 


Questions 




91 


1 .2.3.5.B.7.8. 
9ilO,ll,13 


Surs?ey of" regular ed teachers 

_ - ' ■ 


58 


1 ,4,5,8.11,12. 
13 


Co?T?par3l1 ve study of referral 
procedures 


75 


1,3/6*13,14 


Survey of special ed directors 


14 


4,10,11 ,12,13 


Lon§i tudi^ial study of decision 
making 




6,10,11 ,12,13 


Survey of special ed directors 


60,103 


1 ,3,4,13 


Survey of LD teachers 


66 


2,7 


Survey of regular ed teachers 


29,39 


3,7 




75 76 l3l 


3 7 




g 18 1 g 26 

32,33,34,35 


3 13 


Survey of model LD programs 


11 


11 ,13 


Psycn^metric assessment of low 
achievers 


13 


2 


Direct measure assessment of low 
achievers ^ 


71 


2 


Disturbing Behavior Checklist 
val idation 


8 


3 


Iristructibrial time observations 


95 


6 


Survey of special ed teachers 


' 43 


7 


data 


47 


1 3 


School record review 


136 


13 


Direct measures norm development 


87 


14 


Gomparisah of direct measure eligi- 
bility criteria 


89 


14 


•Development of local norms 


132 


14 


Comparative study of nre-referral 
interventions 


140 


14 
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A twb-oage survey ^orm was used to eHcU infonnatlbn about the 

referred students. In addition to rating the referred student 

•"^^"iat^ve to his/ngr readinq groud classmates, eacH teacher nrbvlded 

Information regarding six factors: fa^ reasons for referral ^ ^b) 

causes of the student' s school difficulties^ (cj interventions 

it tempted within the classroom before referraU (d) desired outcdrnes 

fran the r^eferraU (e) desired outcomes ^rom the assessrtienti and (f) 

desired chanc-^s in the' referred student 'js behavior. Ratings of • 

student's relative to readinq group peers were made on a scale of 1 to 

5 across several dimensionst functioning within the group, 

fonctioninq as typical of the group, abi.lity to learn, soeed of 

learning, rnbtivatioh, behavior, maturity, and judgment. A free- 

resDohse format was used to obtain Information oh the six factors. 

Survey of Requl ar gducatioh Teachers bh Factors Influencing the 
Oec4^i tn to Make a Referral fRR 58) 

During 1931-32, S2 teachers in Hirinesbta and Florida responded to 
a surve:V on several Iss^jes reTated to referral. Sixty percent of the 
teachers were elementary school based, fill but five of the teachers 
were regular education teachers. 

ft 'Si5<-»question open-ended survey was used to obtain information 
on: fa) tP^ referral p LCedure, (b) the number of students referred, 
(c ' Che app»'opriate t^i\e to refer a student, (d) barriers to referrat, 
(ei factors that facilitate referral, and (f) perceived probabilities 
for special education* placement of referred students. 
Comparative Study of R^eferral Procedures fRR 75) 

Twb referral procedures were cbmpared during 1980-81 within six 
elementary schbbls. Al;l schbbls were Ibcated within a SO-mlle radius* 
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of a large metropolian area \o the MidWesfc, and were io smaH to^-^hi 
^•ijral settings. School populations ranged from 110 to 696, On^y 
grade 3-6 stddents were ihcltided JH the comparative study. 

TradU^bnal teacher referral was one of the procedures incTiiidert 
in th»^ study. According to the school districts' quidellnes^ teachers 
first had to ShUiate ah ^htervention wfth a potential candidate for 
rafe^rd^. ff the ihtervehtioh plan failed^ the student then couVd be 
referred for psychoeducat^dhal evaluation. 

The second referral procedure ?nvolvGd weeft;ly measures ent of 
performance in rcFadingi soelling^ and written expression* Students 
who had beeii identified as high risk because they had scored at or 
below the 15th percentile on a screening measure of written express vo?^ 
were- tested wee^.^v\ over a lO-week period^ on measures of readihq, 
soelling, and written expression. Each week^ student performance was 
scD**ed and plotted on a graph. A student was referred ^f hls/H»?r 
performance at least two of the three academic areas was at a level 
more than, two standard deviations below the mean perforrnahce of 
students in the same grade f^dm a Ideal normative sample. 

The students referred by the two procedures were compared with 
respect to referral rate^ cbqhUive function ihg^ achievement levels 
social behavior, se^ differences^ arid identification as^ le^'-ninq 
disabled* 

Survey of Special Education Qirectors on -ftsi^lsmei^t^ and 
6ecision-Maki/)g Pr^tJces im 14) 

nufing 1979^ 100 directors of Special education from 49 states 
provided information on 3ssess??ent and decisfoh-mak ihg practices in 
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tneir school districts. Their school districts were located in rtirali 
urban^ arid sbburbari settings, arid varied widely iri total Dopulatibri 
served arid riumber of pupils a'tteridirig elementary classes. Elementary 
class eriro'Umerit ranged from less than 100 pupils to over 50,000 
pupMs. The aye»*age per-Pupil expenditure for regular educati bh 
services was $1391.2^; the average expenditure for special education 
services was ^2205.50. 

In addition to obtaining background information about the school 
district, the survev form elicited informaticn on (a) the typical 
cdmjxdsition of the teams involved in making screening, placement, and 

_r_ - ___ 

instructional Drogramming decisions, (b) the sequence of steps in the 
assessmefit. and decision-making process, fc) factors thought to 
influence the outcome of the team decisiori-makirig process, arid fd) 
general concerns regarding placement team decisibri making arid the 
developmerit of the individualized educatibrial plan flEP)* 
jL ^n^ii^ixaT S^^^ Decisibri Hakirig {RR 44) 

Naturalistic bbservatibri procedures arid interviews Were employed 
during 1979-80 to study the assessment arid decisibn-makinq events that 
occurred iri the cases of seven students from the time of their 
referra? ^br special education assessment to the time when an 
educati brial brbgram was implemented or a decision was made not to 
provide special education services. The seven cases were selected 
from five elementary schools within a midwesterri metrbpbi itan area. 
Students included were ones , who were referred for eligibil ity arid 
placefnent revaluations, and who were likely to be involved iri the 
entire decision-making process iri t^heir schools. (The lilcelihbbd of 

. • 
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the student being irivpTved in the entire dec iSibh-maki rig process, was 

determirietf- by interviews with school persdrinel and the nature of the 

student's referral problem.) Students who were Clearly mentally 

retarded or sehsorially impaired were not included. 

Data were obtained by (aj observing meetings at which the target 

student was discussed, fbj reviewing reports or other written 

ddcumehts about the student^ and (c) Interviewing key school personnel 

and the student's parent(s);. Written notes on their observation^ and 

interviews were maijitained By the researchers; these were used to 

develop reports on the seven students. the reporti were written to 

provide a description of the events that occurred in each case. 

Sur^vey of Special Education fUrectars on Referral -to-Placemeht 
Probabilities (RR 60/ 103) • 

fJuring 1981, 94 special education directors from 37 states 
responded to a postcard survey. The directors were distributed fairly 
evenly across the four regions of the'^United States^ and were located 
.in rural, urban, arid suburban areas. A letter explaining the purpose 
of the study arid a pbstcard were mailed to over 700 directors. 
Although 164 postcards were returned^ |nany directors indicated they 
did riot have' access to the requested data; others completed the 
postcards iriaccurately. 

For each of three academic years (1977-78, 1978-79, 1979-8D) , the 

postcard survey requested information on (a) the numbers of studen.ts 

» . - - * - - 

referred for psychoeducational evaluation, (b) the riumbers of referred 

students who wer^ evaluated, and (c) the numbers' of evaluated ^studerits 

who received special educati'on services^ 
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Psychometric Assessment of Low Achievers (RR 13) ' * : 

During 1979, samples of 50 school-identified LD students and 49 ^ 

low achievers who had not been identified as LO by their schools were 

• ^ ' - _ 

administered a battery of psychoeducational tests. All students were 

in fourth grade. All non-LD students were low achievers; they Had 

scored at or below the 25th percentile on the Iowa Tests of Basic 

Skills administered during the fall of 1978. bD students were ones 

who had been iderrfeified by their schools as 'tn within six months of - 

the time at which they were? selected to participate in the study. The 

students were from nine school districts within and surrbunding a 

large metropblitari area in the midwest. The two groups were similar 

- - _._ __ _.. _ I 

in terms of age, sex, parental marital status^ father's SES^ mother's 

SES, arid family income. 

All testing was completed by qualified psychometricians and 

occurred during approximately the same period (January to May). The 

tests administered to students were the Moodcock-Oohnson (W-J) 

Psycho-Educational Battery, Tes^s of Cognitive Ability and Tests of : 

Achievement, the Wechsler Intelligence Scale for ehildren-Revised 

(WISC-R), the Peabody Individual Achievement Test (PIAT), selected 

subtests of the Stanford Achievement Test, the Bender Visual -Motor 

_t . ,_ _ - - _ _ _ _ . . 

Gestalt Test (BVMST), the Developmental Test of Visua^Mbtbh 

Integration (DTVMI), the Piers-Harris Self-Concept Scale^ and the 

Peterson-Quay Behavibr Prbblem Checklist. this group of tests was 

selected to reflect thbse devices commdrily used with LD youngsters. - 

Orily 7 of the 10 subtests of the Woodcock-Johnson Tests of Achievement 

, were administered. Administration of the total of ^.49 subtests or 

» 
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tests to the 99 students allowed for the cbmparisdn of the' two groups' 
performances in five domains^ as well as by sub-test or test: 
cognitive (WISC-R^ W-J Cognitive Ability) ^ academic achievement fPIAT,' 
W-O Achievement)^ perceptual ^motor (BVMGT^ bTVMI)^ self -concept 
(Piers-Harris)j and behavior problems (Peterson-buay) . 
Oirect Measure Assessment of^ Low^^Ach^ievers (RR 71) ; 

During 1980-81, a subtest of the students who participated in the 
psychometric assessment of low achievers study were included in this 
study, in which the students' performances on direct measures of 
reading, soelling, and writing were monitored over a five-week perioH. 

Students tested were 34 school-identified tD students and 37 low 

_ " - - i 

achievers, all of whom were in the fifth grade at the time the direct 

measures were administered to them. 

Special educatibri resource teachers in the students' schools 

served as testers. 'These individuals were trained in the 

admini^tratibri bf the academic measures and given materials for each 

content area. ~ FbUr alternate forms were developed for each area, with. 

the same materials used in week 1 and week 5. Examiners assessed each 

student individually, on a weekly basis, for five weeks. 

Survey of L& Teachers on Their Beliefs About LB Students (RR fi6) 

-During 1980-81, a national sample of 127 Lb teachers provided 

information on several factors related to their beliefs about tD 

students and inst;*uctional procedures that work with them. The 

teachers were from 36 states, the District of Golumbii, arid Cariada, 

arid were employed in urbari^ suburban, and. rural cbmmurii ties. Mbst bf 

the teachers were working with elemeritary studerits^ arid mbst were 

female. 

* 
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A two-page survey form elicited irifbrmatiori on the teachers' 
beliefs about LD students and effective instructional interventions. 
Six free-response items asked for descriptions of:' (a) major 
characteristics of LD students* (b) ma.ior reasons children become LO, 
(c) information most useful in determining level and amount of service 
needed by LD students* (d) what works best for teaching reading to LD 
students, (ej what works best for teaching mathematics to LD students, 
and (f) what works best for teaching written language to LD stucfeqts. 
For each r-esponse to these items, subjects were instructed to indicate. 

the ma.ior soruce of their information ^experience, books and Journals, 

__ __ _ _ ___ __ 

training, or other). The survey also presented seven statements abbtlt 

LD students and asked subjects to indicate their agreement with each 

of them oTt a four-point scale from "strongly agree" to "strongly 

disagree." In* addition, subjects were askgd to indicate the extent to 

which 15 student characteristics were a problem in working with LD 

youngsters, using a four-point 'scale from "very significant problem" 

to "not a problem." Finally, the survey asked subjects to provide 

information about their backgrounds, the programs in which they were 

teaching; the children served, and their school district criteria for 

classification of a student as LD-. ^ „ 

Survey ^ Regular gducat.i on Teachers -ori _Their Expectations for 
Si blings of LD Students (RR 29* 39) 

Two samples of regular eeucation teachers were a^urveyed regarding 

their attitudes and expectations for siblings of Lb students during 

- - - ^ _ - 

1979-80. The first sample was considered to be a pilot stMdy sample. 

Pilot study teachers included 18 regular education teachers of 

students in grades K-5. They were from four school distHrts in two 
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metropolitan areas in the midwest; 15 of the teachers Were, female; 

Average years of teaching experience was 15.2^ (range = 8-28). These 

teachers rated 27 students in their classes who were younger siblings 

df"hD and non-tD students; 11 boys and 15 girls were ratedi All 

teachers had previously taught the older sibling of the rated students 

currently enrolled in their classes*. In 16 cases the older sibling 

was bD and in 11 cases the older sibling was not tD, 

The second sample of .teachers included 16 regular third grade 
teachers from seven school districts in a large riletropoli tan area in 
th'3 midwest; 14 of the teachers were _female. Average age of the 
teachers was 36.4 years (range = 26-60) and average years of teaching 
experience was 11 (range = 3-20). Each teSiCher rated hypothetical- 
younger siblings of four students who had been in their classes for 
the entire school year. Two 6f these students were school -identified 
LD students (one girl, one boy) and two were 'non-handicapped students 
(one girl, one boy). ^ 

A rating scale was developed to obtain irifbrmatibn on the 
teachers* expectancies for the behavioral abd academic performances of 
the students being ratedi Measures of academic, motor, perceptual, 
behavfbral, and sbcib-embtibnal functioning were included. 
Expectations for the child'5 overall progress and heed for support 
services . also were measured. All items were rated on a five-point 
s(>a-le from 1 (poor" or deficient performance) to 5 (excellent or 
superior performance), Tn addition ^ each teacher was Interviewed to 
obtain information on the teacher's opinion as to the major cause of 
learning disabrlit'es and the extent to which LO children are able to 
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learn as welt as their "hdrrfial" peers when given appropriate support 
services. * - " ' 

Oeci^i^n^-^^aking Study (RR 9^ 18^ 19^ 26^ 32^ 3-3^ 34^ 85) 

During 1979-80 ,\224 professionals from public 'and private schools 
In ninncsbtu psrticipi^tsd in. a simulated decision-making study. All 
of these professionals previously had participated in at least two 
placement team meetings inVwhich classification decisions were made. 
Disciplines represented witfiin the samole included 58 regular 
education teachers, 79 special Education teachers, 31 administrators, 
30 school psychologists, and 25 other support personnel (e.g., school 
nurses, social workers, etc.). Most of the sample worked in suburb^an 
settings; however, urban and rural ' settings also were represented. 
Approximately 75% of the sample, was female. 

Each sub^iect began by' taking a pretest des igned tc^ evaluate 
knowledge of assessment, the sub^iect then was familiarized with the 
computer terminal that was ufeed to provide requested assessment 
information. After the subject responded to several demographic 
questions presented on the termina.1, the subject was given a referral 
folder in which selected naturaTly-occurring pupil characteristics 
(sex, SES, abpeararice, referral statement of problem) had been varied 
systematically. The subject then was allowed to select assessment 
information* f including technical information on <;pecific test., 
quantitative test scores, arid qualitative test perfbrmarice) for 
approximately 25 miriUtes or until ready to make f irial decisidris about 
the child. Irifbrmatibri was available fbr 49 devices or prbcedures 
grouped within seve# domains ( Intel Tigerice tests^ achievement tests^ 
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perceptual -itidtor tests, behavioral recordings, personality tests* 
adaptive behavior scales, and language testsj^. ^11 test perfbrmlnce 
information presented was indicative of average student performance. 
A series of outcome questions regarding el igibH ity, diagnosis, 
prognnsi^j and other aspects of deci<;iori making were presented. Tn 
addition, each subject ♦ rated the influence of various factors on 
decisions that had been madS. ^ 
Survey of Model-bO Programs (RR 111 • 

During 1978-79, 44 model LD programs (Child Service Oemonstration 
Centers) located in 26 states responded to a survey orj their 
assessment and decision-making practices. All programs, wer^^ ones 
funded during 1978-79 by the Bureau of Education for the Handicapped. 

A two-page survey form was used to obtain information on fa) the 

defihitibri of "learning disabilities" used in the identification of 

children to be served, (b) the kinds of data and the specific 

instruments used for the purposes of screening, placem^riti 

instructional programming, pupil evaluatipn,. arid program evaluation, 

(c) the typical composition of the team making placement decisions, 

•« _* ._ ____ 

and (d) the usual sequence of steps in the assessmerit/decision-making 

process. In addition, data were bbtiairied oil the date each center 

began, and the age range and numben bf children served by each 

program. 

Case StodjT Investigati bn fRR 74, 76^ ISl) 

Burijjg 1980-81, A74 elemeritary teachers reviewed a case study bh 
a third grade male Jtudent exhibiting either unmanageable beha\?ibr4 
.socially immature beh"avior,y^ or perceptual difficulties within the 



classroom. Eighty-six percent of the sample was female and 65% were 
between the ages of 86 and 44. Most i92%) of the teachers tadght in 
public schools; the distribution of participants from various types of 
cbmmuriities (e.g.^ suburban, urban, rural) and grade levels fl-7) was 
relatively even. Teachers f ronr each state, with the exception of 
Alaska, were represented. Two-thirds of the subjects had completed 
bachelor's or master's degrees arid 40% had completed cburseworl^ iri 
special ediicatidri. 

Jhe teachers were ^Ssfgned a specific student summary ( i.e. ^ 

immature^ unmanageable^ perceptuall according to the dr|^ of receipt 

- - - ♦ -' - - - - - - - - - _ _ . 

of their signatures agreeing to participate in the study. The 

materials were sent in two sep'arate mailings. The first set of 

materials included the^student case study and an Actions to Be Taken 

survey. In this survey, teachers' responses to each of 40 statements 

__ A ^_ _: : _ __ 

about intervention were solicited. Each treatment alternative was 
presented iri a seriterice to which the teacher was to iridicate degrees 
of agreemerit (i;e., 5), or disagreement (i.e.^ 1) bri a 1 tb 5 scale. 
The 40 interveritibri chbices ranged frbm thbse iri which the .cl assrbbm 
teacher wbuld have pr^irriary respbrisibil ity, tb those s^gesting sharid 
responsibility^ to those- where the teacher .would have no 
respbrisibil ity 'H'ri implemeritatibii. » The teacher then was sent a 
Disturbing Behavior Checklist 11* Rotter's Internal-External Scale', 
and a demographic infonpatiori form. ' " ^ 



A two-week time limit was suggested for completing each set of 
materials; both a follow-up 1 fetter arid postcard were used to ericourage 
ffie subjects to return completed materials* The final sample iricluded 



52 



« , ' • 



ERIC 



48 

approximately eqdivalarit riumbers of teachers- whO; received and 
evaluated the immature (N=57)i unmanageable (N=B8),:^nd perceptual 
(N=59) students. 

Validation Study of nisturbing Behavior Checklist (RR 8) , 

The nistijrhirig Behavior Checklist II (OBC II) was developed to be 
an indicator of the relative disturbingness of certain behaviors 
characteristic of learning disabilities. A normative study ^ then was 
conducted ditring 1977 to obtain information^ on the "disturbin^ess" of 

each item* as well as data from which to. derive dimensions of 

~^ \ 

disturbing behaviors. 

Approximately 150 advanced undergraduate students were asked to 
complete the DBC II. Each had taken courses in special education, 
none had student taught, and most were female (90%). Respondents were 
asked to ' indicate, on a sea^e from 1 (hot very disturbing) to 5 (very 
disturbing), "Wow disturbing"- each item wa?; "in* working with; 
children." Obtained data w^re subjected to a principal components 
factor analysis. , ;^ ^ * 

Instructional Time Observations of R eferred Students (RR 95) 

Four students were observed systematically 'for two entire schbcrl 

day^s'^each at three different times within the referral to Dlacement 

process during. 1980-81. The students were from four elassrbbms in 

three elementary . schools in a suburban midwestern school district; 

three were male 'and one was female. They were in grades 1-3. The 

students had^ been', referred by their teachers tall femalel to their 

_ _ . __ _ _ 

schools'^ child stady teams for cbnsiderjtidh for special education 

evaluations. ' a 
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Data were recorded on 53- variables within six categories in 

id-secdrid intervals to examine changes in the nature of instruction 

arid academic respbridirtg time as a function of ^oing 'tltrough the 

• referral -tb-i3lacemerit process. The six categories included activity, 

• ■ - 

ts^fe - teachih*^ ' structiirs^ teacher "'ocation^ te^l^her activity,' anrj 

; _ . ~ _» 

student response. Experienced observers ' Coded, the instrjuctio.nal 

ehvironment and. studeni: responses for each student for six ful> days... 

The first two days of ^ata were collecti^ before the child study team 

met to* consider the' referral. The next two days of data were. 

collected approximately one month after an ifeP hard been written for- 

____*_' . ' ' ^ _ ~ _ 

the student. The last two davs of data were collected approximately 

__}___ - ' J _ 

two months after the lEP had been specified. 
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Survey of Special- Education Teachers^ on Their Attributions for 
Observed Student Performance (RR 43) 

Duririg 1980, a study was cbriducted to evaluate the extent to 
which special education teachers iudged the niathematics performance of 
a fourtTi grade boy lio be a function of his handicapping condition 
arid/or his^ competence,/ the subjects were 46 'special education 
teachers, who were enrolled In a week-long inservice workshop on' 
prdgrarrtning for emotional ly handicapped youngsters* ApproocirSately W% 
of the 'group «as female;- the average age , of the participants was 30 
years and average number of years of teachiag ex'perierice was 6. Most 
(54%) of the -participants Were currently teaching • embtibnally 
handicapped youngsters; approximately 20% were teachers iri. learriirig 
disabilities or mental " retardation speeYal classes. About half of the 
teachers were certified in the arep in which they were currently 
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teach tflq arid all of the others were in the process of becbmirig 
certified in their current teachirig area. AH of the teachers Were 
certified in at least one area of special educatidri. 

Each teacher observed a videptape presentation of a studerit 
working uu some aCnlevement test itcmS arid sorr^e perceptual -motor 
tasks, and engaging in a brief free-play period. All student behavior 
on the tape was average. The teacher then reviewed a brief case 
summary that provided information suggesitinq average intellectual 
ability and some minor behavior problems. Half of the summaries 
contained information from an LO teacher and half contained 
information from an ED teacher. Also, student work samples were 
included; half of the teachers saw samples ihdicattnq relatively high 
student eompetencei and half saw samples indicating relatively low 
competence. 

The extent to which the performance of the child was thought to 
be due to various attributes was evaluated by a short questioririaire. 
Teachers were asked to rate the "extent to which" math *'perfdrmarice 
was due to" ability^ level of task difficulty^ charice or luck^ or the 
student's efforts. A rating scale^ in which 1 = not to a great extent 
and 5 = to a grea^ .extent, was used to record the teachers' responses. 

Additiona"' iy^ the participants were a^ked to indicate what scores 

c_ 

(i.e., d-20ro, 21-40%, 41-60^, 61-80?^, 81-100%^ they^thought the child 

b 

would receiv^^ if given a similar math test in the ^future. 
Analysis 5? Psychometric Assessmeat Bata (RR 47) 

During 1980-81, a study was conducted to examine the extent to 
which identificatibri as tD is a function of the definition used, and 

o 
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the extent td which different classifications wou^d resuU from the 
use of different definitions. "^ifty-one students referred for 
psychological evaluation as a result of learning difficulties in 
school were the subjects of this study. Thirty-three boys (^^%) were 
included in the sample. The average age the students was Shears, 
'9 months; the youngest child was 6.6 years old and the oldest was 12;6 
years old. All of the students were from one school district in 
Minnesota. 

The school district criteria for determination of "severe 
diserepahcies" and the "existence of special learriihd disabilities" in 
grades 1.5 through 5.9 were based oh WobdcocR-Jdhhsbh (WJ) perfbrmahce 
measures. If a child's test profile yielded a **severa deficif 
functibriing level, the student was considered eligible for LO S':rvice. 
Additional testing in reading and mat^matics was cofisiiered 
appropriate, if a "moderate deficit" v/as indicated by the 
administration of the W-J aptitude and achievement clusters. By these 
criteria, school personnel identified 24 of the 51 students M7%) as 
eligible for LD services; 

The average age of students identified as LD fX = 8 yearsl was 
not statistically different from the average age of the students not 
identified as bD (X = 9 years); Seventy-one percent (i;e;, 171 of the 
hB students were boys; 50^ (i-e., IBl of the noh-bT students were 
boys; these percentages were not statistically different. 

As part of the diagnostic assessment, each student was 
aidmirii&tered 'several psychometric devices. Tn addition to the W-J^ 
the Wechsier Intelligence Scale for Children - Revised fWlSC-R), and 
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HUerest t^f? extent to whic^j c*>t1dren vdenU fieri !.n by 

v>oUcatyon of the W-J ''severe He^tcir* crUerlon di^fere^j in ot^er 
psycho^et'-ic criaracterist tcs M.e,. WISC-^ anri P|AT oerfo^manc^^} frorn 
cnHdren not i6eniJ^ief^. 

Hu^ino 1^82-1993, school records o? 201 stidents -referred for the 
f'-ir'^t r:^e and ^7 studcntis '■econ^ended for re~e^val>iat in-^ were 
rev^ew^^d; Stud^^nts were fro^n 31 scHooH in d Florida scHob"! di*:.t»"ict 
in ^eh si id'f?^* are referred by C ^l^?qbrv. The records osSd '-n tH$ 
Stjdy were r5ndo?T^1y se^ectt^d. 

Four tybes of inforn^t ion w^r^ xo! U?Cte't for >?.ic^) record:; fa) 
cat-^ao'"v for whTcH student Wfls be^^^: '*eferred., ^b^* cat^^oory for ^htc^ 
student W3S be^nq referred, ^b) -whether th*^ C^^O. w3S 5fi nrU3ir5.1V 
referra-, 'ind fd^ tne decH>on ou^^cofTto, ^e^^ul:^ were su^arUed by 
COSS-t iHu"^atJnQ re^^m for^ r^jferr-t' wtt''^ 0 r:-ice<nent OUtCCKT?e for ^ trst 
p-pf^rrals and re-ev^luat iD»^s separately and by invest iqating the 
effect tine oerson making the referra^ h^d on the outcome; 
Oeve '-apy ^enL o^t -^^ m^s^ f or Pe ri^manc e-OfLiiieect Measures 37 5 

During iQ79-80» direct measures of reading, soel'ird, ^* i^ritAen 
expression were administered to §66 elementary stodefits Fro?n tHree 
st^3t:»3S 5n order to fa) Investigate the feasibilfty of usinq a standard 
task to measure the reading, spelling^ and wrUfhq prbf^ciehcv of 
eien^entary children^ and lb) describe procedures for estabHshing 
1oca« honns oh the standard tastes. The qrade 1-6 students frorn 
Minnesota, Penrisylvahf a, and JJashirjgtbh were selected randon^ly from 
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<;cHbo^ iS<>tr5ct:s that volunteered to participate Irj the stuHv, there 
^e^e 21^> fTia^?s and ?91 ^eSa=»:rs in th*? total sampl»?, >ib ^s^^n eluded 92. 
first qra<fers, 85 second qraders^ 96 third graders^ 99 fourth qraderS, 
IDI '^^fth qr5der<^,, ^nd 93 sixth qr^ders* 

The Minnesota %mp\^ edhsi^ted of 134 of the 5%6tr4-^^^nts, ^3 
boys and 71 q^rls, ^ost of these subjects (73X1 were selected from 
two urb.^n are<^s with pobulatlbhs of SO, 000 and lOO^OOG oeoole. These 
e:i?^^htjrv students were aPprdxirhateJy equally distributed ambriq 
grUes i In 6. The ^ennsy 1 vani.^ sanio'e of students incTuded 157 boys 
dind 169 qiirls, equally distributed across the six grade levels* These 
^^U^rnentary students were randomly selected frcK^ two areas (rural and 
urhan) yr\ f.entral Pennsylvania. The remaininq 106 e'^erneritav'y students 
t«?^,t'?d <<ere fro^ tr*e SeattlT?, Wash ington area; 55 were male and 51 
were fe^^'e, 

f^acH chUd was administered direct measures pf reading^ soellinq, 
jof? wrUi^n expression during the fall and fehe spriftg on an individual 
h^is^s Dv ar^ eiiaminer trained the .administration of the measures. 
^r,^tr» were examined in ter^ns r*" grade tevel differences, annual growth, 
stabi ^ over time, and state, demographic, and sex di*^f erehces . 
Cgr^5ar[son o f Direct Measure Eligibility CvJt^ria f2R^ 89) 

S'jring 19sB?, oerformahee data on direct measures of reading, 
soePing^ >,nd written expressidh were analyzed to determine the 
percentades of students who would be eligifWe for special education 
services by each of four discrepancy crUeria*; The data were obtained 
during 1979^80 from 566 students enrolled in grades 1-6 In Minnesota, 
Peirnsviv'in^a, and Sash in^toM, Oata were entered into four :)eer 



discrepanry criteria (1.5, 2.9, 2.5, and 3.0 times discrepant from 
peers) and the percentage of students classi f ied according to each 
criterion was calculated. 

Oevelopmea^of- tbcal Norms for Direct Measures fRR 1321 

During 1982-83, fall. Winter, and spring local norms for student 
pcrfcrn^a^ce en direct rncasurcs of reading, spell ing, math, and written 
expression were developed. Samples of regular education students from 
six school districts were asked to (a) read aloud from two b^^sal 
reading passages* (b) spell words from a dictated word list tai^lri from 
either a spelling series or a reading series, (c) complete math 
problems in addition, subtraction, multiplication^ and division, and 
(d) complete a written composition in response to a story started. 

A total of almost IBOO' students participated in this local 
norming, with approximately equal numbers from each grade Data 
were summarized on the effect of using different measurement sampling 
plans, the reliTbility of the measures, and the distribution of scores 
within a grade level. Also, the effects of different population 
sampling plans were analyzed. The local norms also were compared to 
national norms and to the effects of the norms on the percentages of 
students served. 

Comparative Study of Pre-Referra-T Interv^entibns fRR 140) 

During 1982-83, tFiree sehools (2 el-emehtary, 1 .iunior high) 
participated in a Study on the effects of implementing a pre-referra1 
intervent-ron system. In this system, cbhsultation^ observation, and 
intervention occdrred before a student entered the typical referral 
far assessTient phase; 
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A survey assessing teachers ' beliefs about sjDecial services and 
teachers* experiences and preferences aOM.: the referral -td-placement 
process was completed in the falV arid spring of the school year. In 
addition referral rates were tabulated at the beqinriing of the school 
year, midway through the school year and at the end of the school year 
for both the current year (1982-83) and the previous year ri981-32h 
Data were analyzed to determine both (a) the effect of the prereferral 
iriterveritidri dri referral rates as compared to the previous year, and 
(b) the extent to which changes in teachers' attitudes occurred over 
the school year. 
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